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RECONFIGURABLE SPATIAL LIGHT MODULATORS 
Field of invention. 

5 

Tliis invention relates to reconfigurable spatial light modulators (SLM) on which 
computer generated dHTraction patterns or holograms may be loaded either as a 
single frame or as a series of frames. 

1 0 Background. 

Re-configurable SLMs based on liquid crystal (and other types of) devices are widely 
used for controlling and manipulating optical beams. In diffractive mode they may be 
used for three dimensional (3D) imaging [BROWN. C V and STANLEY, M. UK Patent 
1 5 Application GB2330471 , Production of Moving images for Hoiograpiiy] and for routing 
optical signals in telecommunications networks [See for example ROSES (Re- 
configurable Optical Switch es) website, http://www- 
g.eng.cam.ac.uk/photonics/rose1 .html]. 

20 The SLM modulates the complex amplitude of an incoming wave front (i.e. changes 
its phase and/or amplitude), which causes it to propagate in the desired manner. The 
SLM generally comprises a liquid crystal panel containing a number of individually 
addressed pixels, onto which a diffraction pattern or Computer Generated Hologram 
(CGH) is written [CAMERON, C D et al, SPIE Conference on Critical Technologies for 

25 the Future of Computing (San Diego, USA). July-August 2000, Computationai 
Chailenges of Emerging Novei True 3D Hoiograpliic Dispiays], 

CGH 3D display systems typically use a computer to generate and/or store electronic 
copies of the hologram. This hologram is then replayed on an SLM which is switched 
30 to modulate (in transmission or reflection) light from a source which then passes 

through suitable replay optics, thereby providing a visible three-dimensional image to 
observers. 



CONFIRMATION COPY 



J 
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For many image generation applications, especially holographic 3D image 
generation, it is important to maximise the image size and/or the range of angles over 
which the image can be viewed. Conventionally, this is achieved by increasing the 
spatial frequency content of the hologram, which increases the achievable diffraction 
5 angle of the modulated beam and/or increasing the number of pixels in the SLM. In 
order to produce satisfactory images, SLMs containing of the order of 10^° pixels may 
be required. An increased spatial frequency is also desirable for many other 
applications utilising diffractive SLMs, such as optical switching. 

1 0 HAINES and BRUM [Proceedings of the IEEE (Letters), pi 51 2-3, August 1 967. A 
Technique for Bandwidth Reduction in Holographic Systems] proposed using a 
ground glass scatter plate as a means of enhancing the viewing angle without having 
to increase the spatial frequency content. The principle was successfully 
demonstrated using a conventional fixed, photographically recorded hologram of a 

15 point source hologram (note: the scatter plate is used in both the recording and re- 
construction stage). KOMAR [SPIE'Vol 120. p127, 1977, Progress on the 
Holographic Movie Process in the USSR] discussed the use of the scatter-plate 
technique as a means of producing holographic "movies" in which the viewing angle 
was big enough for a large audience to see the 3D images. He concluded that the 

20 technique caused unacceptable degradation in the image quality. 

The main factor preventing the introduction of reconfigurable computer generated 
holograms (CGH) in many applications is the number of addressable, reconfigurable 
pixels required in such devices. This is particularly important in the area of 3D image 
25 generation. 



wo 2004/031841 



PCT/GB2003/004284 



J 

-3- 

To ensure adequate fields of view (FOV) and image sizes, conventional approaclies 
typically need a CGH having a pixel count several orders of magnitude liigher than 
that required to produce image resolutions that the human visual system can 
perceive. The simple relation 
5 FOV.I^nm (1) 

(where n is the number of pixels across the display in the plane where the FOV is 
specified, / is image width, and X is the wavelength of light generating the real image) 
shows that, for typical applications (e.g. FO\/=±30°, /=0.05 m), --10^° pixels are 
required to be addressed. This number is enormous. Any method allowing a pixel 
10 count reduction, without significantly compromising perceived image qualities, will 
have great effect on the practicality of such systems. 
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Statement of invention. 

Tlie above problem of a very large pixel count is reduced, according to the present 
invention, by the use of a scatter plate of known feature composition together with a 
5 computer generated diffractive pattern or hologram calculated to pre-compensate for 
effect of the scatter plate. 

According to this Invention, a reconfigurable spatial light modulator system comprises: 
a controller for holding a compensated pattern; 
10 a first spatial light modulator having a plurality of addressable pixels controlled by the 
controller each pixel being capable of modulating incident light and collectively 
replicating the compensated pattern; 

a scatter plate of known characteristics for scattering light from the first spatial light ^ 
modulator; 

1 5 optical means for directing light scattered by the scatter plate and presenting a 
pattern to a receiver; 

the compensated pattern being related to both the scatter plate characteristics and to 
the pattern presented to the receiver. 

20 The scatter plate may be a simple binary phase pseudo random diffuser and may 
have a number of pixels much greater than the number of pixels on the first SLM. 
Other formats may be used. For example multi level pseudo random devices and 
diffusers with periodic structures. 

25 The first spatial light modulator may be an electrically addressable liquid crystal 
spatial light modulator (EASLM) operable either in transmissive or reflective mode. 

The optical means may be a lens system, e.g. a Fourier Transforming lens. 
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The system may include a second SLM which receives modulated light from the first 
SLM; the scatter plate 5 is associated with the second SLM in such systems. This 
second SLM may be optically addressable (OASLM) having substantially the same or 
different number of addressable pixels as the first SLM, and may be of greater 
5 dimensions to give a magnified image or smaller dimensions to provide increased 
spatial frequency. Alternatively, the second SLM may be formed by a number of 
individual OASLMs arranged in a x,y matrix or tiled configuration. When the second 
SLM has a tiled configuration, then scanning means are included for directing 
scattered light to different tiled areas in turn. 

10 

The controller may be a computer having memory for storing basic images and 
calculating means for providing compensated pattem from basic images to take 
account of scattering by the scatter plate. The basic images may be obtained by 
scanning of actual objects, In a manner analogous to forming holographic images in 
15 film material, conventional holography as in USP-6078392, direct to digital 
holography, or by calculation as in computer aided design (CAD) processes. 
Alternatively the computer may have a memory unit for storing images previously 
processed elsewhere, and then read out into the SLM as required. 

20 The system may display holographic images directly to one or more observers. 
Alternatively, the system may further include a receiver, which may be an array of 
detector elements, a bundle of optical fibres, a screen onto which an image is 
projected for observation by one or more observers. The light source may be 
ambient light, or light from a single or multiple light sources such as one or more 

25 optical fibres or lasers. 
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According to this invention a method of providing a holographic image to an observer 
includes the steps of: 

providing a holographic engine for storing a computer generated hologram pattern of 
5 an image to be displayed 

providing a spatial light modulator having a large number of addressable pixels each 
capable modulating light under the control of the engine 

10 controlling the spatial light modulator so that the observer receives a holographic 
image; 

CHARACTERISED BY 

1 5 providing a light scattering plate of known characteristics. to modify light from the 
spatial light modulator; 

calculating and providing a compensated computer generated hologram pattem of an 
image to compensate for the known characteristics of the scattering plate so that an 
'20 observer receives a holographic image. 



The compensated CGH pattem may be calculated using direct binary search 
algorithrn. 
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According to another aspect of this invention a method of increasing the range of 
diffraction angles from a computer designed diffraction structure includes the steps of: 

providing a holographic engine for storing a computer generated pattern of a structure 
5 to be displayed; 

providing a spatial light modulator having a large number of addressable pixels each 
capable of modulating light under the control of the engine; 

10 CHARACTERISED BY 

providing a light scattering plate of known characteristics to modify light from the 
spatial light modulator; 

15 calculating and providing a compensated computer generated hologram pattern of a 
diffractive structure to compensate for the known characteristics of the scattering 
plate so that an increased range of diffraction angles are obtained. 

Brief description of drawings. 

20 

The invention will now be described, by way of example only, with reference to the 
accompanying drawing of which: 

Figure 1 shows a simple form of the invention with a single spatial light modulator and 
25 scatter plate for producing two or three dimensional images to an observer; 

Figure 2 shows another form of the invention having an electrically addressable 
spatial light modulator (EASLM) and an optically addressable spatial light modulator 
(OASLM) of larger dimensions than the EASLM giving an enlarged display; 

30 
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Figure 3 shows a modification of Figure 2 in which the OASLM is fomied of several 
OASLMs connected together in a tiled manner, with optical scanning means to direct 
light from the EASLM to each tile of the OASLM in tum. 

5 Figure 4 shows a small section of a scatter plate having a pseudo random binary 
phase distribution; 

Figure 5 shows an example of an image to be displayed, namely the letters DERA; 

10 Figure 6 is a' schematic of Fourier based 3-D image generation using CGH, it shows 
the relationship between the maximum diffraction anjgle from a SLM, the SLM size 
and the image size and field of view (FOV); 

Figure 7 shows the diffraction angle from an SLM of Figure 6; 

15 

Figure 8 shows the diffraction angle from the present invention with a scatter plate; 

Figure 9 shows a computer generated pattern for applying to a SLM in order to 
produce the display of Figure 5 in the system shown in Figure 6 which does not use a 
20 scatter plate; 

Figure 10 shows an example of an image displayed using a scatter plate as in 
Figure 8, the area of display is about four times that of the similar image of Figure 5 
displayed without the use of a scatter plate by the arrangement of Figure 6; 

25 

Figure 1 1 shows a flow chart for producing a scatter plate capable of doubling the 
size of a two dimensional image generated from a binary phase Fourier CGH, and; 

Figure 12 shows a flow chart for calculating a compensated. pattern to compensate for 
30 scattering by the scatter plate. 



Figure 13 shows an example of an optical switching device using a scatter plate. . 
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Description of embodiments. 

As shown in Figure 1 , a reconfigurable holograpiiic display comprises a light source 1 
whose output is directed through a lens 2 onto an electrically addressable spatial light 
5 modulator (EASLM) 3. This EASLM may be a liquid crystal modulator in which a 
layer of liquid crystal material (nematic, cholesteric, or ferro electric) is held between 
two glass walls. Column electrodes on one wall and row or line electrodes on the 
other wall form a matrix of addressable elements or pixels at electrode intersections. 
When a voltage is applied to a pixel, the liquid crystal material rotates under the 
10 applied electric field to modulate light transmission. High switching speeds are 
obtainable from ferro electric materials, and may include silicon active backplane 
devices. 

A computer 4 controls the signals applied to the SLM 3 and may contain electronic 
15 copies of images to be displayed in both original format and modified format as 
discussed below. 

In front of the SLM 3 is a scatter plate 5. This is shown as separated from the SLM 3, 
but in many cases it will be in contact with the SLM and may be formed on the output 
20 wall of the liquid crystal cell fomning the SLM 3. In another embodiment, a lens or 
optical element (not shown) may be located between the SLM 3 and scatter plate 5. 

Part of one example of scatter plate 5 is shown in Figure 4 to comprise a matrix of 
squares or pixels; each pixel is shown as either transparent or opaque representing 
25 either a zero or a rr phase delay giving a pseudo random binary phase distribution 
pattern used to generate the image of the letters DERA shown in Figure 5. Surface 
features on the scatter plate 5 may be of the same or different size from the pixel size 
of the SLM 3 depending on the layout of SLM 3 and plate 5. For the specific example 
of Figure 4 each pixel is half the linear dimensions of a pixel on the SLM 3. 

30 

A lens system 6 transforms light from the scatter plate 5 to present a three 
dimensional (3-D) holographic image 7 to an observer 8. This image 7 appears to 
float in space in front of the observer 8 at an enlarged size in comparison with a 
system without a scatter plate 5. 
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Some benefits of the scatter plate 5 can be seen by comparing Figures 6 and 7 with 
that of Figure 8. In Figures 6, 7 light from a SLM 3 passes direct through a lens 6 to 
an observer 8 with diffraction angle (|>i. The scatter plate 5 in Figure 8 increases ^2 as 
shown to improve the image size /. 

These Figures 6, 7, 8 show how the diffraction angle 0 from ai CGH limits the size of 
the image (and therefore the FOVJ product in equation 1) produced in a 
conventional, Fourier based CGH system. 



1 0 The value of 0 is given by the grating equation as: 

sin 0 = M2Mp) (2) 
where p is the pixel pitch on the SLM, and M is given below. 

The above shows that larger diffraction angles 0 can be produced for a given number 
1 5 of addressable pixels (or, alternatively, the same value of FOVJ product for a smaller 
number of addressable pixels) by combining the reconfigurable modulator 3 (SLM) 
with a fixed scattering plate (Figure 8). 



If the scattering plate 5 has spatial frequencies of M times the SLM 3, then, for the 
20 same number of addressable pixels n across the SLM: 

FOV.I^Mnm (3) 



The number of pixels that have to be addressed for a given FOVJ product is thus 
reduced by /W^, assuming a unity aspect ratio SLM. So, for M=10 and the FOVJ 
25 product in the example above, only 10^ addressable pixels in the SLM would be 
required. 
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A scatter plate design may be used to increase the size of a 2D image generated 
from a e.g. binary pliase, Fourier CGH. For example the scatter plate of Figure 4 
may be produced by the flow chart steps shown in Figure 1 1 , as described below: 

5 Step 1 . Calculate scatter plate geometry, e.g. to double available range of diffraction 
angles, the scatter plate requires a pixel spatial frequency of twice that of the 
associated spatial light modulator. 

Step 2. Specify the required fraction of pixels in state 0 

10 

Step 3. Starting at the first pixel element, randomly assign a state of 0 orir using a 
probability specified in step 2. 

Step 4. Repeat step 3 for all locations on the scatter plate 

15 

In Figure 11: - 

nsp = number of pixels across the scatter plate 
nsim = number of pixels across the SLM 
Psp = pixel pitch of scatter plate 
20 Psim = pixel pitch of SLM 

M = required ratio of pixel spatial frequencies 

Figure 9 shows a computer generated pattern that can be used with the system of 
Figure 6 (no scatter plate) to control the SLM 3 to form the image shown in Figure 5 
25 to an observer. The Image of Figure 9 is meaningless to an observer unless 
transmitted through a system such as that of Figure 6. There are several known 
ways of producing the pixel distribution of Figure 9. These include W J Dallas, Topics 
in Applied Physics vol 41 , chapter 6, Computer generated holograms. 
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SNhen the scatter plate 5 of Figure 4 is Included as in Figure 1 , then the computer 
generated image of Figure 9 needs to be modified from that of Figure 9. The SLM 
pattem may be calculated using DBS (direct binary search, basic DBS reference: 
Allebach J P, " Iterative approaches to computer generated holography" Proc. SPIE 
5 vol. 884, p. 2-9, (1988)). This modification may be by the DBS algorithm shown in 
Figure 12 as follows: - 

Step 1 ■ Specify intensity distribution of the image to be generated by CGH/scatter 
plate combination (the "target" intensity distribution, e.g. Figure 5), and the region of 
1 0 interest in the optical Fourier transform plane 7 of the system 

Step 2. Specify system parameters (wavelength of operation, focal length of Fourier 
lens system 6, pixel pitch of CGH) 

15 Step 3. Specify scatter plate characteristics e.g. a pseudo-random, binary phase 
distribution, each scatter plate pixel having a retardation of n or 0 at the design 
wavelength, with a pixel pitch of half that of the CGH in the x and y directions (see 
Figure 4). 

20 Step 4, Use DBS (direct binary search) algorithm to optimise the CGH pixel 

distribution, such that when replayed through the scatter plate 5, the system delivers 
the required image having twice the lateral size (4 x the area) of that which would be 
possible from the CGH alone. DBS as follows: 

25 Step 5. Start with random binary phase pattern on CGH. 

Step 6. Assuming on axis replay of the CGH with a plane wave, and that the CGH is 
in contact with the scatter plate, determine the electric field distribution at the output 
surface of the scatter plate, sampled at the centre of each scatter plate pixel. This 
30 can be done using scalar transmittance theory, for example, if the pixel spacings are 
large compared to the wavelength of light used, and the CGH and scatter plate are 
sufficiently close enough together. The number of sample points (and complex 
electric field values) will be 4 x the number of pixels in the CGH, in this example. 
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Step 7. Take the fast Fourier transform of the array of electric field vatues at the 
output of the scatter plate. This gives the electric field distribution in the image plane. 
The modulus squared of this is the intensity in the image plane. Compare this 
5 intensity distribution in the region of interest to the target intensity distribution, using 
some numerical metric e.g. normalised mean squared error (DBS reference above). 
Call this the error e. 

Step 8. Flip the top left pixel of the CGH distribution e.g. if it was of value n, change 
10 its value to 0. if it was of value 0, change it to n. Repeat steps 6 and 7 to determine a 
new enror value enew. If enew<e, then accept the pixel flip and set e= enew- OthenAnse 
flip the CGH pixel back to its original value. 

Step 9. Flip the next pixel (in e.g. lexicographical order) in the CGH and repeat 
15 steps. 

Step 10. Repeat step 9 and continually cycle through all the CGH pixels in the same 
manner. 

20 Step 1 1 . Repeat steps 8 to 1 0 until there are no more accepted pixel flips. 

Step 12. The resulting CGH pattern will be a local solution to the problem of 
determining the CGH pattern required to give the target image distribution when 
replayed through the scatter plate. 
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Incorporating the scatter plate 5 produces advantages as follows: 

The image size can be increased without increasing the number of pixels in the 
SLM, which increases the flexibility of the system. 

5 

There is some perceived degradation in image quality, but this can be controlled, 
therefore the technique is appropriate for high quality imaging applications. 

The number of pixels needed to achieve a certain image size can be reduced, 
10 therefore simpler more cost effective SLMs may be employed. 

For a given image size, the data storage and data bandwidth requirements for re- 
configurable CGHs are reduced, thereby making them more practical to 
implement. 

15 

For a given data storage and bandwidth capacity, the image size available from re- 
configurable CGHs is maximised, thereby producing a more flexible system. 

Whilst calculating a compensated pattern, the computer may also provide correction 
20 or compensation for known aberrations in the various optical components. 

Figure 2 is a simple extension of the an-angement of Figure 1 with like components 
given like reference numerals. In front of the EASLM 3 is a magnifying lens 10, an 
optically addressable spatial light modulator (OASLM) 1 1 . a scatter plate 5. and a 
25 further lens 12. The OASLM is a known component and may con^prise a layer of a 
liquid crystal material between two glass walls. One wall carries a transparent sheet 
electrode (or strip-like electrodes) and the other wall canries amorphous silicon 
photosensitive areas corresponding to pixel areas. 
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When light from the EASLM is incident upon a photosensitive area, a voltage is 
generated to apply an electrical field across the liquid crystal layer under that area, 
thereby modifying its transmission properties. Thus a pattern of light from the EASLM 
is transmitted through the OASLM 1 1 and scatter plate 5 combination to an observer 
5 8 at a greatly increased size. As before the scatter plate 5 is shown separate from 
the OASLM 1 1 but in practice will be close to or formed as part of the front face of the 
OASLM. In another embodiment, the scatter plate may be on the light receiving face 
of the OASLM. 

10 A description of EASLMs and OASLMs used with holographic displays is described in 
patent application EP-1 064651, PCTWO-00/2350472. GB98/04996. 

Figure 3 is a further extension of Figure 2. In this Figure 3 the OASLM 14 is formed 
by sixteen separate OASLM devices each being one tile 1 1 in a 4x4 matrix or tiled 

1 5 arrangement; other size matrixes can be formed. Each separate tile 1 1 is similar to 
that of the OASLM of Figure 2 and has the same number of pixels, as does the 
EASLM 3. Between the scatter plate 5 and OASLM 14 is an optica! arrangement 15 
for directing the output of the scatter plate 5 to one of the tiles 1 1 at a time, and to all 
the tiles in a sequence; e.g. in a raster manner. By this means a large display formed 

20 of many separate images can be formed on the OASLM 14. Such an arrangement 
relies on the high speed of the EASLM 3 and visual persistence by the observer 8. 
Additionally, the tiles 1 1 may be bistable or have a slow turn off time to reduce 
flickering. The system of Figure 3 is similar to that in GB2330471 with the addition of 
the scatter plate 5. Images may be observed either by transmission of light through 

25 or reflection from the OASLM 14. 
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One potential advantage of the OASLMs 11,14 are that they may modulate light at 
wavelengths other than that of the light source 1 . For example the light source 1 may 
generate light of a narrow wavelength range to control the EASLM 3 and hence the 
OASLMs 1 1 . 14. These OASLMs 11.14 may then transmit or reflect light from 
5 additional sources (not shown), either white light or red, blue and green light to 
provide a colour display e.g. in a frame or line sequential manner. 

The scatter plate 5 of Figure 4 is a simple binary phase pseudo random diffuser. 
Other formats may be used. For example multi level pseudo random devices and 
10 diffusers with periodic structures. 

The examples in Figures 1-10 above are concerned with holographic images. The 
invention is also applicable to two dimensional displays and to optical switching. 

15 When used for two dimensional displays, larger images can be shown without 
increased pixellation or the same size displayed with reduced pixel numbers in the 
SLM 3. The enlarged image may be directed onto a reflective (or transmissive) 
screen for viewing by several observers; or the enlarged image viewed by an 
observer 8 as in Figures 1 and 2. 

20 

In the optical switching device shown in Figure 13, an an-ay of X./22 detectors (17) 
may be arranged at the image plane (instead of an observer 8) and receive a signal 
on any one of its detectors, from the SLM 3. The array of detectors may be a bundle 
of optical fibres, each capable of receiving light separately from one of mi x optical 

25 fibres or diode lasers (15) behind the SLM 3. A collimating lens array (16) may be 
used to direct the light from the source an-ay onto the SLM. The benefit of the scatter 
plate 5 is that of increasing the available diffraction angle for a given SLM, therefore 
increasing fan out capability or allowing different packaging layout e.g. a larger 
detector spacing or shorter SLM to detector distance. The computer may be a 

35 memory chip storing pre-calculated SLM patterns for each of the connections 
required. 



